Avatar Puppetry Using Real-Time Audio and Video Analysis
نویسندگان
چکیده
We present a system which consists of a lifelike agent animated in real-time using video and audio analysis from the user. This kind of system could be used for Instant Messaging where an avatar controlled like a puppet is displayed instead of the webcam flow. The overall system is made of video analysis based on Active Appearance Models and audio analysis based on Hidden Markov Model. The parameters from these two modules are sent to a control system driving the animation engine. The video analysis extracts the head orientation and the audio analysis provides the phonetic string used to move the lips.
منابع مشابه
The Role of Avatar in Interactive Fictional World of Video Games
In third-person video games, players are able to move and progress in the interactive world of the game while watching their avatar from an external point of view. The purpose of this paper is to investigate the role of avatar in the interactive imaginary world of video games using double vision theory. This article is based on descriptive-analytical methods and the use of library data and imag...
متن کاملExperiments in Digital Puppetry: Video Hybrids in Apple’s Quartz Composer
In this paper, I document a prototype musical performance called Of Minnie the Moocher and Me. I describe the workings of a performance system made using Apple’s Quartz Composer that explores screen based digital puppetry and scenography, hybrid ‘mixed reality’ video composites and the software programming that enabled wireless bluetooth control of an on-screen avatar with a popular game contro...
متن کاملVirtual encounters. Creating social presence in net-based collaborations
The paper discusses the experience of "social presence" as a relevant effect dimension of avatarmediated net-communication. Special attention is paid to measurement issues combining subjective verbal reports of social presence with objective behavioral data relating nonverbal activity, visual attention and person perception. Data will be reported from a study comparing the effects of different ...
متن کاملاستفاده از اینترانت به صورت اتصال بی سیم Real-Time Point to Point برای نمایش زنده و همزمان جراحی لاپاراسکوپی، کمک به اتخاذ تصمیم در جراحی و راهنمایی Telementoring در جراحی لاپاراسکوپی: اولین گزارش از ایران
Background and Aim: To determine whether an inexpensive set up of point to point wireless intranet connection can provide adequate video and audio teleconferencing and image quality to support remote real-time surgical demonstration and telementoring. To our knowledge, there is no similar report from Iran. Materials and Methods: Surgeon performing a novel laparoscopic extraperitoneal trigonopl...
متن کاملTowards an Empathizing and Adaptive Storyteller System
This paper describes our ongoing effort to build an empathizing and adaptive storyteller system. The system under development aims to utilize emotional expressions generated from an avatar or a humanoid robot in addition to the listener’s responses which are monitored in real time, in order to deliver a story in an effective manner. We conducted a pilot study and the results were analyzed in tw...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007